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ABSTRACT 


This  paper  presents  a  new  model  and  branch-and-bound  algorithm 
for  the  m-travelling  salesmen  problem.  The  algorithm  uses  a  Lagrang- 
ean  relaxation,  a  subgradient  algorithm  to  solve  the  Lagrangean  dual, 
a  greedy  algorithm  for  obtaining  minimal  m-trees,  penalties  to  strength¬ 
en  the  lower  bounds  on  candidate  problems,  and  a  new  concept  known  as 
staged  optimization.  Computational  experience  for  both  symmetric  and 
asymmetric  problems  having  up  to  100  cities  is  presented. 


This  research  was  supported  in  part  by  the  Air  Force  Office  of 
Scientific  Research  under  Contract  Number  AFOSR  77-3151.  This  work 
was  part  of  the  first  author’s  dissertation. 


1 .  OVERVIEW 


This  paper  extends  the  highly  successful  algorithm  of  Held  and 
Karp  [11,  12]  for  the  travelling  salesman  problem,  to  the  m-travell- 
ing  salesmen  problem.  The  algorithm  involves  the  use  of  a  Lagrangean 
dual  within  a  branch-and-bound  structure.  A  subgradient  procedure 
is  used  to  solve  the  dual  and  it  is  shown  that  a  greedy  algorithm 
may  be  used  to  evaluate  points  of  the  dual  function. 

We  now  formally  state  the  m-t>mve£LLng  6aZeAme.n  pnobtejm.  We 
define  a  touA  beginning  at  city  n  as  a  sequence  of  distinct  cities 

{n,  i  ,  ±2’  •••»  i^}  where  SL  _>  1.  Given  n  cities  (1 . n)  and  m 

salesmen,  all  based  at  city  n,  we  wish  to  find  a  set  of  m  tours  such 
that  each  city  other  than  n  is  a  member  of  exactly  one  tour.  Let  c 
denote  the  distance  from  city  i  to  city  j  and  let  c  .  +  c.  .  +  ... 

n  i  -j 

c.  .  +  c.  denote  the  distance  for  the  tour  {n,  i, . i„}.  The 

ViH  v  i  A 

objective  is  to  select  m  tours  (one  for  each  salesman)  such  that  the 
total  distance  for  all  tours  is  a  minimum.  A  related  problem  has  also 
been  discussed  in  the  literature  in  which  the  objective  is  to  select 
at  most  m  tours  with  total  minimum  distance  (see  [2]).  Clearly,  for 
m  =  1  both  models  are  the  classical  travelling  salesman  problem.  If 

the  distances  c^  =  c j i  ^or  C^cy  pairs,  then  this  model  is  called 
i>yn\mzt>vLc.\  otherwise,  it  is  called 

This  model  was  first  formulated  in  integer  programming  terms  by 
Miller,  Tucker,  and  Zemlin  [17].  Svetska  and  Huckfeldt  [18]  developed 
a  specialized  branch-and-bound  algorithm  for  this  problem  which  uses  a 
linear  programming  relaxation.  Also,  Gavish  and  Srikanth  [7]  developed 


_ — ^  .A  VN 


a  branch-and-bound  algorithm  which  uses  a  different  relaxation.  The 


Gavish-Srikanth  model  does  not  permit  the  use  of  a  greedy  algorithm 
to  solve  subprobleras  whereas  our  model  does.  Bellmore  and  Hong  [5] 
proved  that  the  asymmetric  version  of  this  model  was  equivalent  to 
an  asymmetric  travelling  salesman  problem  on  n  +  m  -  1  cities.  The 
question  of  whether  this  problem  should  be  attacked  directly  as  in 
[7,  18]  and  the  present  work  or  whether  it  should  be  converted  to 
its  one  salesman  equivalent  and  solved  using  [3]  or  [12]  is  an  open 
question. 
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II.  THE  MODEL 


In  this  section  we  present  a  new  model  for  the  m-travelling 
salesmen  problem.  The  model  is  developed  using  the  notion  of  an  m- 
tree,  which  is  a  generalization  of  the  Held-Karp  1-tree.  The  m- 
tree  is  defined  such  that  it  has  the  matroidal  property  so  that  the 
integer  — ’ogramming  relaxation  is  solvable  via  a  greedy  algorithm. 
The  original  generalization  proposed  by  Held  and  Karp  [11]  is  not 
matroidal. 

Let  the  decision  variable 


x.  . 
ij 


r 

j  1,  if  some  salesman  travels 
(  from  city  i  to  city  j; 

0,  otherwise. 


Assuming  that  each  salesman  is  based  at  city  n,  we  call  any  tour  on 
cities  1,  ....  n  -  1  a  AubiOuA.  Then  the  m-travelling  salesmen  pro¬ 
blem  may  be  stated  mathematically  as  follows: 


n  n 


min  J  }  c . . x  .  . 
i=l  j=l  « 


(1) 


n 

f 1,  for 

y 

x,  .  - 

L 

k=l 

kj 

1  m,  for 

n 

j"  1,  for 

l 

k=l 

Xik  = 

1  m,  for 

x.  .  = 

0  or  1 

1 


Xii  =  0 

no  subtours. 


(all  i) 


(2) 


(3) 


(4) 


(5) 
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For  the  classical  travelling  salesman  problem  (i.e.  m  =  1),  a  pair 
of  expository  papers  by  Held  and  Karp  [11,  12]  showed  that  (4)  and 
(5)  could  be  replaced  by  a  constraint  that  required  the  graphical 
structure  associated  with  any  feasible  vector  x  to  be  a  1-tree.  A 
J--t4.ee  on  a  graph  having  n  nodes  (cities)  is  a  spanning  tree  on  n-1 
nodes  and  two  distinct  edges  connecting  node  n  to  two  other  nodes. 

Letting  Y  =  {(xn>  . xnl>  ...,  =  0,  x±.  =  0 

or  1  and  the  edges  ij  having  x  =  1  form  a  1-tree},  the  travelling 
salesman  problem  may  be  stated  as  (1),  (2),  (3),  x  e  Y,  and  m  =  1. 

We  now  generalize  the  notion  of  a  1-tree  to  an  m-tree. 

Aii  m-.V icc  on  a  gaaph  having  n  node*  is  an  acyclic 
g-iaph  having  n-m-1  edges  on  n-1  nodes  and  2m  edges 
such  that  the  edge  { n,i )  nevea  appeals  moae  than 
twice. 

Note  that  every  m-tree  has  n+m-1  edges  and  an  m-tree  need  not  be 
connected.  A  set  of  2-trees  is  illustrated  in  Figure  1  while  Fig¬ 
ure  2  illustrates  some  graphs  having  n+m-1,  (6) .  edges  which  are  not 
2-trees.  The  graph  in  Figure  2a  is  not  acyclic  on  nodes  1  and  2 
and  the  graph  in  Figure  2b  has  three  copies  of  the  edge  (5,2). 

Letting  X  =*  {(xn,  ....  x^,  ...,  x^,  ...,  x^):  x^  =  0, 
x_  =  0  or  1,  and  the  edges  ij  with  x  =  1  form  an  m-tree},  the 
m-travelling  salesmen  problem  may  be  stated  as  follows: 


mm 


1  - 
ij  ij 


(6) 


f  1,  for  j  =  1,  . . .  ,  n-1 


m,  for  j  =  n 


( 


(7) 


fl,  for  i  -  1,  ....  n-1 

l  xik  =  < 

k  |^m,  for  i  =  n 


(8) 


x  e  x 


(9) 


A  model  having  only  n  constraints  in  place  of  (7)  and  (8)  exists 
for  the  symmetric  m-travelling  salesmen  problem  (see  Ali  [1]). 


Figures  1  and  2 
About  Here 
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III.  THE  ALGORITHM 


In  this  section  we  present  a  branch-and-bound  algorithm  for  the 
m-travelling  salesmen  problem.  The  algorithm  uses  a  Lagrangean  relax¬ 
ation,  a  subgradient  algorithm  to  solve  the  Lagrangean  dual,  a  greedy 
algorithm  for  evaluation  of  a  point  of  the  dual  function,  penalties 
to  strengthen  the  lower  bounds  obtained  by  the  greedy  algorithm,  and 
a  new  concept  known  as  staged  optimization.  Each  of  these  techniques 
are  explained  in  the  subsections  to  follow. 


3.1  Lagrangean  Relaxation 

The  Lagrangean  dual  of  (6)  -  (9)  selected  for  this  algorithm  is 
as  follows: 


where 


max 

0(u, 

,v) 

(10) 

u,v 

n-1 

n-1 

0(u, 

v)  = 

min  { J  c  . 

.  il 

x£X  ij  J 

*ij 

+  z 

i=l 

u. ()  x. .  ■ 

- 1) 

n 

n-1 

n-1 

+ 

u  (I  x  .  - 

m) 

+  l 

v.(T  x. .  ■ 

-  1)  + 

ni=l  nJ 

•J  M 

j  =  l 

Ji=l  1J 

vn(£  Xin  "  m)K  (11) 

1=1 

n-1 

After  rearranging  terms  G(u,v)  =  min  c..x..}  -  a  where  a  =  £ 

xeX  ij  1J  1J  k=l 

(u,  +  v,  )  -  m(u  +  v  )  and  c.  .  =  c  +u.  +  v..  The  Lagrangean 
k  k  n  n  ij  ij  i  J 

dual  has  been  used  by  both  Held  and  Karp  [11,  12]  and  Bazaraa  and 
Goode  [3]  in  their  highly  successful  work  on  the  travelling  sales¬ 
man  problem.  Our  relaxation  is  a  natural  extension  of  their  model. 
Lagrangean  relaxation  for  general  integer  programs  has  been  exten¬ 
sively  studied  by  Geoffrion  [10]. 
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1 

1 

Consider  the  following  results  which  relate  the  Lagrangean  dual  ■ 

and  the  primal. 

Theorem  1.  (Bazaraa  and  Shetty  [4]) 

Let  x*  solve  (6)  -  (9)  and  let  (u*,v*)  solve  (10),  (11).  Then 

0(u* ,v*)  <  T  c . .x* . . 

-  H  U 

Theorem  2.  (Bazaraa  and  Shetty  [4]) 

0(u,v)  is  concave. 


Theorem  3.  (Geoffrion  [8]) 

Let  (u , v)  be  any  vectors,  let  x  C  X  solve  G(u,v)  and  let 


[  x  -  1,  for  i  =  1 . n-1 


^  il 


r 

i 


l  X  -  m,  for  i  =  n 


1 


il 


r  _  . 

1  X  -  1,  for  j  =  1,  ...,  n-l 


s  i 


s  .  = 
J 


!  I  xn  -  m,  for  j  -  n. 

L 


i 


The  vector  (r,s)  is  a  subgradient  of  0(u,v)  at  the  point  (u,v), 


The  above  three  results  are  well-known  and  are  easily  proved.  Given 
the  optimal  vectors  associated  with  both  the  primal  and  dual,  the  non¬ 
negative  quantity 


l  C . .X* .  -  0(u*,v*) 

ii_  1J 


l 

ij 


C  .  .X* 

11  Ij 


(12) 


is  called  the  duouLUty  gap. 


For  this  work,  the  subgradient  algorithm  ([13,  15])  is  used  to 


solve  the  dual  (10)  and  (11).  Our  implementation  of  this  general 
method  is  presented  below. 


A LG-1:  SUBGRAVIENT  OPTIMIZATION  METHOD  FOR  DUAL 
0.  PaAcmeXdA  Selection  and  Inltlaliza.tlon 

a.  [Select  Step  Size  Parameters]  Select  G,  H.  X.,  X-. 

b.  [Set  Initial  Solution]  u  0,  v  0,  u*  *■  0,  v*  0, 

r*  «-  0,  s'*  *■  0. 

c.  [Set  Lower  Bound]  L 

d.  [Obtain  Over  Estimate]  Set  G  such  that  G  >  max  G(u,v). 

_  u,v 

e.  [Initialize  Counters]  i  ■*-  1,  h  +•  0. 


1. 


Selva  Subpfioblcm 

a.  [Evaluate  Dual  At  (u,v)]  Let  x*  solve  min 

xcX  ij 


b. 


set  G  £ 

ij 

[Determine 


c . .  x* .  -  a. 
ij 

Subgradient ] 


1,  for  i  =  1,  .. 


m,  for  i  =  n 


c  .  . x .  . }  and 
1 3 


n-1 


1 

i 

J 


s . 
J 


I  1  X*. 

I I  ,J 


l,  for  j  =  1, 

m,  for  j  =  n 


c.  [Test  For  Optimality]  II  r  =  s  =  0,  -P  with  (u,v)  an 
optimum  for  the  dual  and  x*  an  optimum  for  the  primal. 

d.  [Improved  Solution?]  If  0  >  L,  then  L  -  G,  u*  u,  v*  ■*-  v, 
r*  ■*-  r,  s*  ■>-  s,  and  go  to  2. 
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e.  [Test  Step  Size  Counter]  h  *■  h+1.  If  h  =  H,  go  to  3. 

2.  Move  To  New  Potnt 

(u,v)  (u,v)  +  [X.(0  -  0)/ |  ! (r , s ) |  |]  (r,s),  and  go  to  1. 

3.  Change  Step  Stze  Ox.  Terminate 

If  i  =  G,  terminate  with  (u*,v*)  as  an  optimum  for  the  dual; 
otherwise,  h  ■*-  0,  i  *■  i+1,  (u,v)  ■*-  (u*,v*)  +  {X i [ G  -  0(u*,v*)]/ 

| | (r*,s*) | | } (r* , s*) ,  and  go  to  1. 

An  excellent  discussion  of  convergence  results  for  the  subgradient 
algorithm  are  given  in  Helgason  [14], 

3.2  Matroidal  Structure  of  K-Trees 

To  implement  ALG-1  efficiently,  one  needs  a  fast  procedure  for 
solving 

min  {)  c . .x.  .  }.  (13) 

xeX  ij  1J 

In  this  section  we  show  that  X  has  a  matroidal  structure  and  (13)  may  be 
solved  by  a  greedy  algorithm. 

We  now  present  results  from  matroid  theory  which  will  be  used 
in  the  development  of  an  efficient  algorithm  for  (13).  Recall  that 
a  maXACtd,  M  =  [Z,  i^],  is  a  finite  set  Z  and  a  set  i[’  of  subsets  of 
Z  such  that  the  following  axioms  hold: 

Ml.  <p  £  ip. 

M2.  If  X  £  p  a^d  y  X,  then  V  c  p. 

M3.  If  U,  1/  £  p  with  |(l|  =  |l/|  +1,  then  there  exists  an  x  £  U  -  V 

such  that  l/Vj{x}  £  ip. 

Z  Z 

Let  2  denote  the  power  set  of  Z.  Then  the  elements  of  ^C2  are 

z  z 

called  independent  subsets  of  2  and  2  -  \p  are  called  dependent 

subsets.  A  maximal  independent  subset  is  called  a  bdie. 


-9- 


We  now  show  chat  a  greedy  algorithm  can  be  used  to  find  a  mini¬ 
mum  weight  base.  Let  £  C4  denote  the  set  of  bases  for  some  matroid. 

2 

Let  w  :  Z  ->  R  be  a  weight  function  and  extend  this  to  w  :  2  -+  R  as 
follows: 

w(C)  =  l  w(e),  CCZ. 
eeC 

The  minimal  weight  base  problem  may  be  described  as  follows: 

Find  X  e  3  such  that 

w(X)  =  min  w(6).  (14) 

Bcp 

An  optimal  base  X  may  be  obtained  by  employing  the  following  algo¬ 
rithm. 


ALG-2:  GREEDY  ALGORITHM  EOR  A  MINIMAL  WEIGHT  BASE 
0.  XQ  -  4',  i  <-  1,  Y  -  Z. 

1.  Find  such  that  w(x^)  =  min{w(x)  :  x  e  Y,  {x)UX,  ^  E  <^}.  If 
no  such  x_^  exists,  stop,  X^_^  is  an  optimum. 

2.  X^  -1-  X  ^tHx  ),  Y  *■  Y  -  {x  ),  i  ■>-  i+1  and  go  to  1. 

Edmonds  [6]  proved  that  ALG-2  produces  an  optimum  for  (14). 

To  apply  Edmonds  result  to  problem  (13)  we  must  show  that  X 
(the  set  of  m-trees)  is  the  set  of  bases  for  some  matroid.  If  this 

can  be  shown,  then  (13)  can  be  solved  by  the  efficient  greedy  algo¬ 
rithm  (A LG-2). 

A 

Let  A  =  { (i,  j)  :  1  <_  i  n-1,  i  <_  j  <_  n-1  ,  i  4  j } ,  A  =  { (i,n) , 

A 

(n ,  i)  :  1  i  <_  n-1},  and  let  A  =  AUA.  Then  we  will  call  a  set 

A 

X  —A  independent  if  the  edges  of  X  do  not  form  a  cycle.  We  will 
call  a  set  XC A  independent  if  j XJ  <  2m.  Furthermore,  XCA  will 
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V  \ 


be  called  independent  if  |Xf)Aj  n  +  m  -  1  and  Xf)A  and  Xf'iA  are 
independent.  Let  be  the  set  of  all  independent  subsets  of  A. 
Clearly  a  maximal  independent  subset  of  A  is  an  m-tree.  Hence,  we 
need  only  show  that  [A,  1^]  is  a  matroid  to  prove  that  ALG-2  solves 
(13). 

Before  proving  that  [A,  i^]  is  a  matroid  we  develop  the  following 
preliminary  result. 

Theorem  4 . 

Let  G  be  a  graph  and  let  be  the  set  of  all  spanning  trees  of 
G.  Let  E^C  and  E^CS^  where  S^,  e  fl  and  |  E^|  =  m  ,  |  E^  |  =  m^, 

m^  >  m?.  Then  there  exists  an  arc  e  e  E^  -  E2  such  that  E^  {e}CS^ 

e  fi. 

Proof.  Suppose  G  has  n  nodes.  Then  has  n  -  components  and 
has  n  -  m^  components.  Suppose  E^  has  no  arc  e  =  (i,j)  such  that  i 
and  j  are  in  different  components  of  E^.  This  implies  that  E^  has 
at  least  n  -  m^  components.  Then  n  -  m  _>  n  -  m0  ^  which 

contradicts  m^  >  m,, .  Therefore,  there  exists  an  e  E  E^  -  E^  which 
connects  two  components  of  E2  and  E2^{e}(_S^  e  This  completes 
the  proof  of  Theorem  A . 

Theorem  A  will  be  used  in  the  proof  of  the  following  result. 

Theorem  5 . 

[A,  is  a  matroid. 

Proof.  Axioms  Ml  and  M2  hold  trivially.  Therefore,  we  must  show 

A 

that  M3  holds.  Let  and  E  ^  with  |U^|  -  ,j^,  |u^DA|  =  t^, 
jU.nA|  =  s^,  i  =  1,  2  and  u^  •=  u2  +  1.  Let  e  C  '  l^. 

Case  1:  (s^  >  s^).  If  s^  >  s^,  then  there  exists  an  arc  e  £  [(U^H 
A)  -  U  ]  for  which  U2  \J  {e>  e  i p. 
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A  VS 


Case  2:  (s^  £  S2).  If  s^  s^,  then  ^  +  1.  Now  (U^QA)  and 

A 

(l^OA)  have  no  cycles.  By  Theorem  4,  there  exists  an  e  c 


(U^HA)  -  (l^flA)  such  that  (U2MA)U{e}  has  no  cycles. 
Therefore  U  U 

This  completes  the  proof  of  Theorem  5. 

Therefore  the  minimal  m-tree  problem, 


min  { J 
xeX  ij 


c. .x. .}, 
ij  iJ 


is  solvable  via  ALG-2. 


3.3  Separation 

In  [2]  it  is 
n  city  asymmetric 


n-1 
'  m 


shown  that  the  number  of  feasible  solutions  for  an 
m-t ravelling  salesmen  problem  having  m  salesmen  is 


'  (n-2)! 

/  (m-1) !  ‘ 


(15) 


The  proof  of  this  result  is  constructive  and  shows  precisely  how  one 

may  generate  an  enumeration  tree  for  this  problem. 

The  tree  is  generated  in  two  phases  with  phase  1  corresponding 

to  n  ^  in  (15)  and  phase  2  corresponding  to  -7— .  Assume  that 
^  m  fm— i ; ! 

the  tree  is  constructed  from  top  down  and  let  the  single  top  node 
correspond  to  level  0.  All  nodes  at  level  £  in  the  enumeration  tree 
will  have  Jt  arcs  fixed  and  the  tree  has  n-1  levels  since  fixing  n-1  arcs 
uniquely  determines  an  m-tree.  The  first  phase  corresponds  to  the 
levels  1  through  m  while  the  second  phase  corresponds  to  levels  m+1 
through  n-1.  The  two  phases  of  the  enumeration  tree  construction 
are  now  given. 

Phase  1 :  At  level  0,  construct  n-m  new  nodes  by  fixing  arcs  (n,l), 
(n,2),  ...»  (n,n-m).  For  the  node  with  fixed  arc  (n,j), 
construct  n-nrt-l-j  new  nodes  by  fixing  arcs  (n,j+l), 


(n,n-m+l).  For  any  node  at  level  £  (sm)  having  arcs 


(n,j1),  ....  (n, j^)  fixed  where  j  >  jk>  construct 
n-nrHi-j^  new  nodes  by  fixing  (n.j^+l),  . ..,  (n,  n-m-£). 
Phase  2:  At  level  £  •>  m,  for  any  partial  solution  having  £  arcs 
fixed,  there  are  n-l-£  nodes  which  have  no  fixed  arc 
into  them.  Choose  one  of  these  nodes,  say  q.  Then 
n-£+m-2  new  nodes  are  constructed  by  fixing  the  appro¬ 
priate  arcs  whose  "to"  nodes  is  q.  In  developing  the 
enumeration  tree,  the  node  (city)  selected  to  create 
the  new  nodes  is  the  one  whose  component  in  the  sub¬ 
gradient  differs  from  0  the  most. 

A  partial  enumeration  tree  for  six  cities  and  two  salesmen  is  illus¬ 
trated  in  Figure  3. 


Figure  3  About  Here 


3. A  Problem  Selection 

Following  the  notational  conventions  of  Geoffrion  and  Marsten 
[9],  we  represent  the  enumeration  tree  by  a  set  of  candidate  prob¬ 
lems  which  are  maintained  in  the  candidate  list.  Let  CP.  denote  a 

l 

candidate  problem  with  fixed  arcs  (i  ,  j.),  (ip,  jp).  Define 


iL  corresponding  to  CP^  as  =  {(x^,  ...,  xnn)  : 


=  l}.  Then  CP^  is  the  problem. 


:  xi  j  =  • * •  xi  < 
1J1  £J 


min  )"  c  .  ,x.  . 
• •  i] 


r  1,  for  j  =  1,  ... ,  n- 


L 

r 


l  -  ' 

X  ik  ,  ,  . 

k  C.  m*  *or 


m,  for  j  =  n 

1,  for  i  **  1,  . . . ,  n-1 


x  e  Xf|Yi. 
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We  make  use  of  two  relaxations  of  CP^  in  the  branch-and-bound  algo¬ 
rithm.  The  relaxation  CP^  is  the  Lagrangean  dual. 


max  0(u,v) 


where  0(u,v)  =  min  {£  c..x..}  -  a,  while  CP2  is  simply  G(u,v)  = 

xeX.OY.  ij  13  1J  1 

1 

min  {V  c..x..}  -  a.  CP^  is  used  only  at  the  initial  node  in  the 
xeXPY.  ij  13  13  1 

enumeration  tree,  and  CP^  is  used  at  all  other  nodes  where  (u,v)  is 

the  optimal  solution  of  CP^. 

— 9  — 2 

Let  v(CP“)  denote  the  optimal  objective  value  of  CP^.  Then  a 

— 2 

lower  bound  for  all  nodes  constructed  from  CP.  is  v(CP.),  Let  CP.,, 

1  1  l+l 

be  any  descendent  of  CP^  with  £  +  1  fixed  arcs  and  let  the  arcs 
selected  by  the  greedy  algorithm  for  CP2  and  CF“+^  be  given  by 


(l£+l,j£+l) 


(ln+m,3n+m')  and  '‘V3!^  ”*  (V3P  (l£+l* 


3£+l^ 


(i 


n+m ’ 3  n+m 


).  Since  the  greedy  algorithm  was  used  to  obtain 


— r>  — 2 

the  solution  to  CP7  and  CP..,,  then 
1  l+l 


c?  ?  >  C7  t  for  k  =  £+2 . n+m.  (16) 

Vk  Vrk-i 

Thus,  summing  (16)  we  obtain 

I  'n  !  !  •  <17) 

k-k+2  kJk  k=2+2  k-lA-l 


Adding  [  c.  .  +  c:  t  +  c?  ?  to  both  sides  of  (17),  we 

k=l  Vk  V"3-1- 


1m+n3nr+n  1£+13£+1 


obtain 


v(CP2  .)  >  v(CP2)  +  c?  ?  -  cv  - 

11  1  1£+1^£+1  1mfn3m+n 


(18) 


Then  the  right-hand-side  of  (18)  provides  a  lower  bound  for  CP,+^„ 
The  candidate  problem  selected  at  each  iteration  is  the  one  with 
smallest  lower  bound. 
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3.5  The  Algorithm 

Using  the  ideas  of  the  previous  sections,  we  now  summarize  the 
new  branch-and-bound  algorithm  for  the  asymmetric  m-travelling  sales¬ 
men  problem.  The  algorithm  incorporates  a  new  idea  which  we  call 
■itagad  optimizcutLOn.  Following  the  conventions  of  [9],  let  CL  de¬ 
note  the  candidate  list  and  INC  denote  the  objective  value  of  the 

A 

incumbent.  Let  Z*  denote  an  estimate  of  the  Value  of  the  optimal 
solution.  This  estimate  is  based  on  the  observed  duality  gap  and, 
of  course,  may  be  either  larger  or  smaller  than  the  optimal  value. 

A 

The  branch-and-bound  algorithm  is  executed  with  Z*  playing  the  usual 
role  of  the  incumbent,  INC.  This  may  substantially  aid  the  fathoming 
routine  with  the  risk  of  fathoming  an  optimum.  If  a  feasible  solution 

A  A 

is  found  such  that  INC  <  Z*,  then  the  fathoming  strategy  using  Z*  was 
justified  and  the  algorithm  guarantees  optimality.  If  the  complete  tree 
is  fathomed  without  obtaining  a  feasible  solution,  then  the  fathom¬ 
ing  strategy  was  not  justified  and  the  optimum  has  objective  value 

A  A 

greater  than  Z*.  For  this  case  Z*  is  increased  and  the  procedure 
is  repeated.  A  similar  idea  has  been  reported  by  Marsten  and  Morin 
[16]. 

The  algorithm  incorporating  staged  optimization  follows: 

A  LG-3:  BRANCH- ANV-BOUNV  MET  HOV  FOR  M-TRAVELL1NG 
SALESMEN  PROBLEM 

0.  JnltlaLizcutLon 

Choose  9  ,  9^,  9^,  ...  for  staged  optimizni  on,  set  t  *■  1,  and 
set  INC  +- 
1.  Sci'vc  Vual 

Use  A  LG—  7  to  solve  the  dual.  Let  (u*,v*)  denote  the  optimal 
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dual  variables  and  let  x*  solve  mini!  c..x..},  Set  the  lower 

xeX  Ij  1J  ^ 

bound  L  0(u*,v*)  and  let  (r*,s*)  denote  the  subgradient  of 
0(u* ,v*) . 

2.  T&6 t  F  or  Duality  Gap 

If  r*  =  s*  =  0,  stop  there  is  no  duality  gap  and  x*  solves  the 

A 

primal;  otherwise,  set  Z*  *■  L(1  +  3  ). 

3.  Construct  First  Level  In  Enumeration  Tree 

Construct  the  first  n-m  nodes  in  the  enumeration  tree  and  place 
them  in  the  candidate  list. 

4.  Solve  New  Candidate  Problem 

Y  -  —  Y 

Let  Y  e  CL  and  let  x  solve  min  {)  c,.x.  }.  Let  0. ,  =  Y  c..  x.., 

.  11  11  Y  “ .  lj 

xeXi  iY  ij  J  J  ij  J 

and  (r^.,  Sy)  denote  the  subgradient. 

5 .  Fathom  T est 

A 

If  0^  >  Z*  go  to  7 . 

6.  Feasibility  Test 

A 

If  ty  =  Sy  =  0,  x*  *-  Xy,  INC  *■  0y,  Z*  *■  C'y ,  fathom  candidate  prob¬ 
lems  with  lower  bounds  greater  than  0y5  otherwise  go  to  9. 

7 .  T erminati on  T est 

If  the  candidate  list  is  not  empty,  then  go  to  4. 

8.  New  Stage  Required? 

A  A 

If  INC  i  Z*,  then  set  t  t  +  1,  L  Z*,  and  go  to  3;  otherwise, 
stop  with  x*  as  the  optimum. 

9.  Separate 

Separate  Y,  update  the  candidate  list,  and  go  to  4. 

Note  that  A LG-3  can  be  easily  converted  into  a  method  to  find  approxi¬ 
mate  solutions.  The  interval  of  uncertainty  at  any  point  in  the  proce¬ 
dure  is  [INC,  L).  An  additional  test  in  step  6  is  required  to  make  this 
conversion. 
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IV.  COMPUTATIONAL  EXPERIENCE 


The  branch-and-bound  procedure,  ALG-3,  has  been  coded  in  stand¬ 
ard  FORTRAN  for  an  in-core  implementation.  The  code  was  initially 
tested  on  randomly  generated  asymmetric  problems  on  a  CDC  6600.  The 
random  number  generator  employed  for  the  generation  of  problems  is 
the  one  available  on  the  CDC  FTN  compiler.  The  range  used  for  gen¬ 
erating  the  distances  was  [100,  3400],  The  same  range  was  used  by 
Bazaraa  and  Goode  in  their  computational  work  on  the  travelling 
salesman  problem  [3].  Since  the  code  is  designed  for  an  in-core  im¬ 
plementation,  one  of  the  major  problems  encountered  in  the  computa¬ 
tional  testing  was  core  storage.  The  size  of  the  candidate  list 
grows  rapidly  for  the  larger  problems,  n  >  50  and  the  storage  re¬ 
quirement  soon  exceeds  the  a\ailar!.e  200K  octal  words,  even  with 
most  of  the  data  packed. 

The  computational  efficiency  of  the  code  is  sensitive  to  the 
selection  of  parameters.  Bazaraa  and  Goode  observed  that  there  is 
a  trade-off  in  the  amount  of  computational  effort  expended  in  the 
maximization  of  the  dual  and  the  branch-and-bound  procedure.  The 
more  time  spent  in  A LG-1 ,  the  better  the  lower  bound  obtained.  We 
employed  =  2  *  in  the  code  and  G  and  H  were  selected  based  on 
the  size  of  the  problem.  The  subgradient  procedure  increases  the 
lower  bound  L  rapidly  in  the  initial  iterations  and  minimal  increases 
are  obtained  for  G  >  10.  However,  for  larger  problems,  we  found  it 
beneficial  to  use  a  larger  value  for  G,  even  though  the  relative 
increase  in  the  lower  bound  is  minimal.  Further,  the  choice  of  the 
duality  gap  estimates  3^  is  crucial.  If  they  are  chosen  too  large, 
then  the  candidate  list  grows  rapidly,  while  if  they  are  too  small. 
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the  number  of  candidate  problems  solved  increases. 


Our  initial  computational  experience  centered  on  evaluating 
the  behavior  of  the  code  to  parameter  selection  and  to  the  type 
of  problem  being  solved.  Table  1  summarizes  computational  results 
for  asymmetric  problems  for  n  =  30,  40,  50,  and  60  with  1  <  m  <  n/10. 
The  parameter  settings  for  the  first  seven  sets  used  were  H  =  5,  G  * 

10  and  3^  =  .01,  3^  =  .02,  and  3^  =  .03.  We  found  that  the  duality 
gaps  for  problems  with  n  =  50  and  60  were  smaller  than  .005  and 
further,  the  number  of  subproblems  generated  with  lower  bounds  with¬ 
in  one  percent  of  the  solution  for  the  Lagrangean  dual  was  large. 
Problem  sets  9-12  were  solved  with  the  duality  gap  estimates  set 
to  31  =  .005,  32  =  .01,  33  =  .015. 

The  general  conclusions  which  may  be  drawn  from  the  results  of 
problem  sets  1  -  12  is  that  the  duality  gap  seems  to  decrease  as  m 
increases.  Further,  the  problems  with  larger  values  of  m  are  easier 
to  solve  than  those  with  smaller  values  of  m.  However,  as  the  prob¬ 
lem  size  increases,  the  number  of  candidate  problems  within  small 
percentages  of  the  lower  bound  obtained  from  the  Lagrangean  dual 
increases.  To  circumvent  the  consequential  storage  problem,  we  have 
devised  an  approximation  technique  which  simply  consists  of  termi¬ 
nating  the  branch-and-bound  procedure  as  soon  as  a  solution  is  ob¬ 
tained.  The  solution  so  obtained  is  provable  to  be  within  a  small 
percentage  of  the  optimal  solution.  Since  the  staged  optimization 
technique  makes  use  of  estimates  of  the  duality  gap  of  a  problem, 
it  is  possible  to  obtain  a  suboptimal  solution  within  a  known  percen¬ 
tage  of  the  true  solution  by  terminating  the  branch-and-bound  pro¬ 
cedure  as  soon  as  an  m-tour  is  obtained.  This  approximate  solution 
technique  was  tested  on  problems  for  n  =  60.  The  results  are  summarized 
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in  problem  sets  13  -  18  of  Table  1.  To  obtain  a  tighter  lower  bound, 
G  =  12  was  used  with  8^  =  .005,  8^  =  »01,  and  8^  =  .02. 

Table  1  About  Here 


Table  2  reports  computational  results  for  the  solution  of  25 
100-city  problems  for  which  solutions  were  obtained.  There  were 
25  other  problems  which  terminated  due  to  storage  limitations  be¬ 
fore  locating  an  ra-tour.  For  the  use  of  the  approximate  technique, 
a  better  selection  procedure,  which  makes  use  of  the  subgradient,  can 
be  devised  so  that  an  m-tour  can  be  located  before  the  number  of  can¬ 
didate  problems  becomes  unmanageable  (see  [1]). 

Table  2  About  Here 

To  gain  insight  into  the  solution  of  symmetric  m-travelling 
salesmen  problems,  we  attempted  to  solve  50  100-city  problems  by 
randomly  generating  such  problems.  The  range  on  the  costs  used 
was  the  same  as  for  asymmetric  problems.  For  such  problems,  the 
code  was  slightly  modified  so  that  the  subgradient  employed  had  n 
rather  than  2n  components.  However,  the  enumeration  tree  was  not 
modified  for  these  problems,  nor  were  other  specializations  made. 
Computational  results  for  15  problems  which  were  successfully  solved 
are  given  in  Table  3.  The  remaining  35  were  terminated  due  to  stor¬ 
age  limits.  The  problems  which  were  solved  had  negligible  duality 
gaps,  and  thus  solutions  were  obtained  before  the  candidate  list 
grew.  The  computational  results  indicate  that  the  duality  gap  for 
large  problems  is  exceedingly  small.  Thus,  even  though  minimal 
increases  are  obtained  in  the  course  of  final  iterations  of  the 
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subgradient  procedure  for  maximizing  the  dual,  it  is  beneficial  to 
employ  larger  values  for  G. 

Table  3  About  Here 

Table  4  gives  results  on  Euclidean  problems  obtained  by  the 
use  of  intercity  distances  which  were  provided  by  the  Civil  Aero¬ 
nautics  Board  for  59  cities.  Because  the  code  has  not  been  designed 
for  the  solution  of  such  problems  specifically,  the  computational 
experience  on  these  problems  is  not  extensive.  Rather,  the  focus 
here  was  to  obtain  insight  into  the  nature  of  solutions  to  such 
problems.  Five  networks  were  chosen  arbitrarily  and  three  problems 
were  defined  for  each  network.  The  first  four  networks  have  30 
nodes  each.  Networks  III  and  IV  differ  only  in  the  choice  of  the 
base  node.  The  solutions  to  the  problem  are  illustrated  in  Figures 
4-8.  The  most  interesting  inference  that  may  be  drawn  from  the 
solutions  is  the  relationship  between  the  duality  gaps  for  the  prob¬ 
lems  and  the  solutions.  The  solutions  to  the  six  problems  on  net¬ 
works  I  and  II  are  intuitively  obvious,  whereas  the  solutions  to 
the  problems  on  networks  III  and  IV  are  not.  Thus,  the  harder  the 
problem,  the  larger  the  duality  gap.  Furthermore,  note  the  manner 
in  which  solutions  to  problems  on  the  same  network  are  related.  From 
the  first  three  networks,  it  would  seem  that  realistic  m-travelling 
salesmen  problems  would  have  to  be  further  con,  trained  to  ensure 
that  each  salesman  visit  at  least  some  minimi.:-;  number  of  cities. 
Failing  this  constraint,  solutions  of  the  kind  illustrated  may  be 
expected.  Whereas,  as  the  number  of  salesmen  increases,  as  in  Fig¬ 
ure  7,  the  solutions  become  more  meaningful.  That  is,  not  all  but 
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one  salesmen  travel  to  only  one  other  city.  The  solutions  obtained 


for  the  network  on  59  nodes  are  illustrated  in  Figure  8.  For  the 
problems  on  networks  III,  IV  and  V,  even  though  the  initial  estimates 
of  the  upper  bounds  used  were  quite  close  to  the  true  duality  gap, 
the  number  of  subproblems  examined  before  verification  of  optimality 
is  large. 


Table  4  About  Here 


Figures  4-8  About  Here 

Based  on  our  computational  experience  using  the  technology  de¬ 
veloped  in  this  exposition,  we  have  arrived  at  the  following  conclu¬ 
sions  : 

(i)  The  duality  gap  for  problems  with  up  to  100 
cities  is  quite  small  (less  than  1%). 

(ii)  Holding  the  number  of  cities  constant,  the 
problems  become  easier  to  solve  as  the  num¬ 
ber  of  salesmen  increases  and  the  duality 
gap  decreases. 

(iii)  Exact  solutions  for  problems  with  up  to  50 
cities  can  be  obtained  routinely  with  the 
implementation  of  the  algorithm  reported. 

(iv)  A  in-core/out-of-core  algorithm  using  this 
technique  could  be  used  to  solve  problems 
having  100  cities. 
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Figure  3.  Partial  Enumeration  Tree  For  n 
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Figure  5. 


Illustration  of  Solutions  to  Problems 
On  Network  II. 
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Figure  6 


Illustration  of  Solutions  to  Problems 
On  Network  III. 


Figure  8 


Illustration  of  Solution;; 
on  Network  V. 
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to  Problems 


Results  are  for  Suboptimal  Solutions  .  (Interval  of  Uncertainty  =  Duality  Gap) 

Some  problems  in  the  set  were  not  solved  due  to  storage  and  time  limits.  (For  set 
for  set  13;  2,  for  set  15,  1). 
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